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A number of colleges and universities are beginning to use competency based 
exit examinations in order to evaluate the success of their general education 
programs. One recent trend on U.S. campuses has been toward larger numbers of 
older, more experienced, entering students. This trend is due in part to 
an aging U.S. poulation, second career choices and more part-time students. 
The question to which this study addresses itself is whether or not this 
type of outcome testing is appropriate for use with students who have had 
the ooDortunity to gain knowledge from experiential learning situations 
compared to students who enter college directly from high sfchool. 



Older adults are entering higher education in 
increasing numbers. This increase is a direct result a-fthe 
changes taking place in the population. It is estimated 
that by tli^ year 2000 there will be an increase in adults 
between the ages o-f 35 and 44, and that people over 55 years 
o-f age will comprise 27X of the entire population. This 
increase in the older adult student population is taking 
place when there is a decrease in the number of traditional 
18 to 22 year old potential students. Many older students 
are going to college for the first time, whereas others 
return to complete their degree or get job retraining. One 
of the difficulties faced by the older students has been 
related to thR fact that most of these students are seeking 
educational experiences which are deliberately and 
explicitly associated with cairBBr performance (Greenhill, 
Metz, 8< Stander, 1982). College curricula often do not meet 
current professional needs (Chapman & Cleaveland, 1973). 
Older students may have different educational needs than 
their younger counterparts (Williams S< Rich, 1978). One of 
the first steps necessary in the development of programs 
which will meet the needs of this population is adequate 
assessment of the 1 earni ng exper i ence. 

There have been very few attempts at educational 
outcome assessment of the ol der students' uni versi ty 
experience. A few studies have assessed the impact of the 
learning process on mature adults after they leave the 
educational system. However, these have generally focused 



on specialized programs or groups (Speer & Dorfman, 1986). A 
number oi colleges and universities are beginning to use 
competency basQd examinations to evaluate the success of 
their general education programs. These exams, typically 
gi ven to enter i ng freshmen and then acai n to graduat i ng 
seniors, are used to assess progress toward "effective adult 
functioning", skills which may develop curing the course of 
the students' col 1 ege careers. 

Some institutions use the American College Testing 
(ACT) Program's College GLitcomc Msa^ursrs Prcjcrct (CGMP) . 
The COMP evaluates students in three content areas: 1) 
Functioning in Social Institutions, 2) Using Science and 
Technology, and 3) Using the Arts, and in three process 
areas: 1) Communicating, 2) Solving Problems, and 3) 
Clarifying Values, as well as providing a Total COMP score. 
The i nstrument asks students to appl y knowl edge and ski 1 1 s 
in situations encountered in everyday living. Scores on the 
COMP purport to predict effective functioning in adult 
roles. Scores obtained on the instrument have been shown to 
correlate with other indicators of effective functioning, 
such as job supervisor ratings and economic status of job 
function (Forrest, 1982). 

The purpose of thi s paper i s to rai se some queati nns 
regarding the validity of these assessment measures with 
older students who have gai ned knowl edge from pxper i enti al 
learning situations compared to the validity with students 
who enter directly from high school. Another purpose of 



this study is to look at what type o-f assessment would be 
helpful to both the older students and the institutions they 
attend . 



The students in the sample were administered the COtiP 
in the last quarter of their senior year. A total of 863 
students were tested, 129 o-f whom were 25 years of age and 
older (mean age = 28.6). These older students consisted of 
52 females and 77 males; 114 were White, 6 Black, 6 Asian, 



43 part-time, and 42 we.>re unemployed. Seventy-four were 
single, 46 married. 

Scores for the older studentr^ were compared to the 
scores of 734 younger students. This younger group 
consisted of 350 females and 383 males. Six hundred and 
eighty-five were White, 30 Black, 11 Asian, 2 Ajierican 
Indian, and 2 Hispanic. Six hundred and fifty-nine of the 
younger subject^i were single, and 68 were married. 

The sub j ects were admini stered the ob jecti ve porti on of 
the COMP examination^ This test is a "proxy" measure for 
the Composite Examination; it yields a maximum total score 
of 240 points for General Education, plus subscores in three 
process areas (Communicating maximum score = 72, Solving 
Problems maximum score = 96, Clarifying Values maximum score 
= 72) and three content areas (Functioning within Social 
Institutions maximum score 80, Using Science and 
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Technology maximum score = 80, Using the Arts maximum score 
= 80) (Forrest & Steele, 1982). 

The total COMP scores and subscores were compared -for 
the two groups, as well as their entering ACT scores and 
grade point averages. These relationships were examined 
using Analyses o-f Variance. The relationship between total 
COMP score, incoming ACT scores, and grade point averages 
were also determined by using a Pearson correlation method. 
Data obtained on the demographic variables (sex, race, and 

mar- it si StsitUl^s) SrS w V2l LiS*" . 

RESULTS AND DISCUSSION 
Older students scored higher than their younger 
counterparts on the Total COMP score and on the subscores 
obtained in the three content and three process areas . The 
comparison o-f COMP scores with students' grade point 
averages and incoming ACT scores showed a signi-ficant 
relat'.onship between COMP Total score and grade point 
average. These results are presented in Tables 1 and 2. 
The Pearson correlation coe-f-f ici ent calculated -for the 
relationship between COMP Total score and grade point 
average was .31, and the correlation obtained -for the COMP 
total score with incoming ACT score was .55. Both o-f these 
moderate correlations were signi-ficant at the .001 level. 
This signlgicant correlation could also be partially 
attributed to the large sample size. No signi-ficant 
relationships were -found as a result o-f the analysis o-f the 
e-f-fects of sex, race, and marital status, and COMP Total 



' Table 1 



Analysis of Variance Smnmary Table: Younger and Older Students 
on COMP Total Score, Grade Point Average, and Incoming ACT Scores. 



Source of 



Variation 


df 


SS 


Ml 


F 


uurir loiai icore 
Between Groups 
Within Groups 


1 

861 


1369.09 
193588.23 


1369.09 
224.84 


6.08* 


Grade Point Average 
Between Groups 
Within Groups 


1 

857 


3.42 
188.05 


3.42 
0.21 


15.58* 


Incoming ACT Scores 
Between Groups 
Within Groups 


1 

700 


9.74 
17018.50 


9.74 
24.31 


.40 



*Signiricant at £<'.01 



- Table 2 



Analysis of Variance Summary Table: Younger and Older Students 
on COMP Subscores . ' 



Source of 
Variation 


df 


SS 


MS 


F 


Funclilonina within 
Social Institutions 
Between Groups 
Within Groups 


1 

861 


112.47 
28361.93 


112.47 
32.95 


3.41 


Using Science and 
Technology 
Between Groups 

Within Hroun^ 


1 


120.88 


120.88 


3.98* 


Using The Arts 
Between Groups 

Within Rrounc 


1 


169.98 


169.98 

"^Q QQ 


4.24* 


Communicating 
Between Groups 
Within Groups 


1 

861 


31.43 
35J66.51 


31.43 
41.78 


.75 


Solving Problems 
Between Groups 
Within Groups 


1 

861 


366.18 
34978.26 


366 ,18 
40.63 


9.01* 


Clarifying Values 
Between Groups 
Within Groups 


1 

861 


95.88 
2256.99 


95.88 
26.19 


3.66* 



*Significant at £^.05 
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tiai increases may not be evident a*^ the end o-f a student's 
college career. Thus colleges with large proportions of 
older students may experience smaller increases in overall 
COMP scores than colleges without this type o-f population. 
This could be problematic, since in many cases, student 
achievement is one o-f the criteria by which state 
legislatures determine the allocation of state funds for 
higher educat i on. An eval uat i on process should be consi stent 
with the knowledge, values, and goals, of older students, 
and it should be based on a theory of adult learning 
(Decker, Redhorse, Lucas, & Adams, 1977). 

The question of how to appropriately assess educational 
outcome becomes more complex with the needs and backgrounds 
of older students, if the administrative goal of assessment 
is to evaluate the learning experience in order to 
facilitate improvement of teaching and learning. A 
prospective study should assess younger and older students 
separately, beginning with the admission process and 
continuing throughout the educational experience. Cross 
(1986) states that evaluations should be formative, 
emphasizing improvement of the educational process. Often 
assessment results have impact only on the institutional 
1 evel , not on the actual teach i ng /I ear ni ng experience of the 
individual. The issue of acade.nic freedom in the classroom 
neeus to be addressed. The use of the ACT COMP may ba valid 
if employed as one of multiple assessment measures; a single 
observation of educational outcome is unreliable and 
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score* In looking at the results of the ANOVA, the standard 
deviation and standard error o-f measurement are larger -for 
the older students than -for younger students. A possible 
conclusion which can be drawn from this is that the older 
student group appears to be more diverse and heterogeneous 
than the younger group. 

The research -findings on the effectiveness of this 
standardized test with older students are inconclusive if 
one is searching for a single assessment measure. It would 
seem that the ACT COMP may not be the most accurate measure 
for use with older students, since this group does seem to 
score significantly higher than younger students. These 
score differences are likely to be the result of older 
students' experiences in work, recreation, family, and 
possibly retirement activities, and as a result of these 
life ex pen ences, they may have gai ned competenci es i n the 
higher level skills of analysis, synthesis, and evaluation. 
It is significant to note that two-thirds of the older 
students were employed full-time or part-time. Therefore, 
they are gaining experience by combining the world of 
learning with the world of work. 

Forrest and Steele (1982), in the COMP technical 
manual, state that the COMP examination did not correlate 
wi th age. However, they did not speci f i cal 1 y admi nister the 
the test to students who were older than the average student 
population. A possible negative consequence of this finding 
is that if competencies are higher to begin with, substan- 




invalid. Convergent validation procedures need to be 
employed, such as behavioral assessments which coincide with 
knowledge and attitudes. Educational assessments should 
include as much of the total individual experience as 
possible, including personal goals, interactions with 
friends and pro-fessors, and the support group available. 
Assessing students' competencies cannot be an exact science 
dependent upon one speci-fic standardizf?d instrument. Most 
learning is based on a combination of individual differences 
and what the institution adds to the unique development cf 
each student. 
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